Papers with Data Effectiveness Score
Scale Down to Speed Up: Dynamic Data Selection for Reinforcement Learning (2025.findings-emnlp)
Copied to clipboard
| Challenge: | Current approaches to Reinforcement Learning (RL) rely on massive static datasets, leading to computational inefficiency and redundant gradient updates. |
| Approach: | They propose a data-centric RL framework that dynamically selects the most informative training samples to optimize RL for mathematical reasoning. |
| Outcome: | The proposed framework achieves comparable performance to full-data training methods while requiring only 1.5K samples instead of 220K, reducing training time from 13 days to just 4 hours on 8A800 GPUs. |